feat(slo): Add index sorting on SLI and split per day #244978
+136
−86
Conversation
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
github-actions
bot
added
the
author:actionable-obs
kdelemme
added
backport:skip
baileycash-elastic
requested review from
baileycash-elastic
and removed request for
baileycash-elastic
Contributor
💔 Build Failed
Failed CI StepsTest Failures
Metrics [docs]
History
|
Contributor
|
Pinging @elastic/actionable-obs-team (Team:actionable-obs) |
Contributor
|
Pinging @elastic/obs-ux-management-team (Team:obs-ux-management) |
kdelemme
commented
Dec 3, 2025
| index_patterns: [SLI_INDEX_TEMPLATE_PATTERN], | ||
| composed_of: [SLI_COMPONENT_TEMPLATE_MAPPINGS_NAME, SLI_COMPONENT_TEMPLATE_SETTINGS_NAME], | ||
| priority: 500, | ||
| priority: 600, |
Contributor
Author
There was a problem hiding this comment.
To override the previous index template matching on broader index pattern, e.g. .slo-observability.sli-* instead of .slo-observability.sli-v3.6* like now
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
3 participants
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Resolves #244697
Resolves #244678
Summary
This PR bumps the SLO resources version to 3.6, meaning only new SLOs or SLOs updated with a breaking change or reseted will use the new index settings and ingest pipelines.
This PR changes the date_index_name date rounding processor to daily instead of monthly. Customers can always use
slo-rollup-global@customingest pipeline to override this settings if necessary.We also added index sorting on the SLI index settings using [id, revision, instanceId] which are the first ordered keys referenced by the summary transform. This will help tremendously the composite aggs made by this transform.
On the overview cluster, where each daily index has about 20M documents with a size of 20GB, the write_load decreased compared to the write_load of previous indices who were not using the index (but who had way more documents, e.g. monthly instead of daily rollup), so we cannot really compare apples to apples... But at least the overview cluster is not overwhelmed with this settings.
And from @henrikno testing with a 300gb index, the query ran by the summary transform went from 2min to 2s using this settings.
Testing
Release notes